Finite Size Scaling of Perceptron
نویسنده
چکیده
We study the first-order phase transition in the model of a simple perceptron with continuous weights and large, but finite value of the inputs. Making the analogy with the usual finite-size physical systems, we calculate the shift and the rounding exponents near the transition point. In the case of a general perceptron with larger variety of outputs, the analysis gives only bounds for the exponents.
منابع مشابه
Finite size scaling of the Bayesian perceptron
We study numerically the properties of the Bayesian perceptron through a gradient descent on the optimal cost function. The theoretical distribution of stabilities is deduced. It predicts that the optimal generalizer lies close to the boundary of the space of ~error-free! solutions. The numerical simulations are in good agreement with the theoretical distribution. The extrapolation of the gener...
متن کاملFinite Size Scaling in Neural Networks
We demonstrate that the fraction of pattern sets that can be stored in singleand hidden-layer perceptrons exhibits finite size scaling. This feature allows one to estimate the critical storage capacity ac from simulations of relatively small systems. We illustrate this approach by determining ac , together with the finite size scaling exponent n, for storing Gaussian patterns in committee and p...
متن کاملFinite-size effects and optimal test set size in linear perceptrons
Huctuatiolls in the test error are important in thelaming theory of finite-dimensional systems as they represent how well the test error matches the average test emr. By explicitly finding the variance of the test ermr due to randomness present in both the data set and dgonthm for a linear perceptron of dimension n. we are able to address such questions as the optimal test set size. Where exact...
متن کاملConsistency of Microcanonical and Canoni - cal Finite - Size Scaling
Typically, in order to obtain finite-size scaling laws for quantities in the microcanonical ensemble, an assumption is taken as a starting point. In this paper, consistency of such a Microcanonical Finite-Size Scaling Assumption with its commonly accepted canonical counterpart is shown, which puts Microcanonical Finite-Size Scaling on a firmer footing.
متن کاملCritical finite-size scaling with constraints: Fisher renormalization revisited
The influence of a thermodynamic constraint on the critical finite-size scaling behavior of three-dimensional Ising and XY models is analyzed by MonteCarlo simulations. Within the Ising universality class constraints lead to Fisher renormalized critical exponents, which modify the asymptotic form of the scaling arguments of the universal finite-size scaling functions. Within the XY universality...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2000